Before you run your TestComplete tests as part of a pipeline managed by Azure DevOps or Team Foundation Server, make sure that your test agents meet the following requirements:
-
Make sure that your agent is running as an interactive process. Running TestComplete tests on agents running as a service is not supported.
-
An interactive user session must be opened on your test agent. You can open the session manually, or, if you use Team Foundation Server 2018 or later, you can configure your agent to run with the auto-logon enabled to open the session automatically when it starts. You enable the auto-logon when you configure your agent. To learn about configuring agents, see docs.microsoft.com/en-us/azure/devops/pipelines/agents/.
-
Your test agents must have Visual Studio or Visual Studio Test Platform installed. As an alternative, you can use the Visual Studio Test Platform installer task to install Visual Studio Test Platform on your agents during the build run or release deployment.
-
Your test agents must have TestComplete (or TestExecute) installed.
You can use the Enable TestComplete support task to install TestComplete (or TestExecute) on agents.
-
TestComplete (or TestExecute) on the agents must be licensed properly and be able to access the licensing server:
-
If you use the key-based license, they must be able to access the licensing server running in your local network.
-
If you use the SmartBear ID-based license (recommended if you use Microsoft-hosted agents), they must be able to access the SmartBear License Servers online:
https://manage.smartbear.com:443
https://api.slm.manage.smartbear.com:443
https://login.slm.manage.smartbear.com:443
https://server.manage.smartbear.com:443
https://server.slm.manage.smartbear.com:443
https://profile.id.smartbear.com:443
https://profile-api.id.smartbear.com:443
https://auth.id.smartbear.com:443
-
-
If your test agents are running under Windows 8.1, Windows 10, or Windows Server 2012, make sure that TestComplete (or TestExecute) is properly prepared and has all the necessary privileges. See Working With TestComplete via COM - Overview.
-
Make sure that your TestComplete test projects once copied to a remote agent are able to access all files required to run tests. For example, if your test reads test data from an external file, make sure that file is accessible from your test agents.
See Also
Integration With Azure DevOps and Team Foundation Server via TestComplete Test Adapter
Integration With Azure DevOps and Team Foundation Server - Requirements